Expressive Multimodal Conversational Acts for SAIBA Agents
نویسندگان
چکیده
We discuss here the need to define what we call an agent conversational language, a language for Embodied Conversational Agents (ECA) to have conversations with a human. We propose a set of Expressive Multimodal Conversation Acts (EMCA), which is based on the Expressive Speech Acts that we introduced in a previous work, enriched with the multimodal expression of the emotions linked to these acts. We have then implemented these EMCA for SAIBA-compliant ECA, and specifically for Greta. We were able to use Greta in experiments aimed at assessing the benefits of our language in terms of perceived sincerity and believability of an ECA using it to interact with a human user.
منابع مشابه
Modular definition of multimodal ECA communication acts to improve dialogue robustness and depth of intention
In this paper we propose a modular structure to define communication acts with verbal and nonverbal elements inspired in the SAIBA model. Our modular structure is a conceptual interpretation of the functional features of a multimodal interaction platform we have developed, with an embodied conversational agent (ECA) that implements verbal and gestural communication strategies aimed at minimisin...
متن کاملRepresenting Communicative Function and Behavior in Multimodal Communication
In this paper I discuss how communicative behavior can be represented at two levels of abstraction, namely the higher level of communicative intent or function, which does not make any claims about the surface form of the behavior, and the lower level of physical behavior description, which in essence instantiates intent as a particular multimodal realization. I briefly outline the proposed SAI...
متن کاملRealActor: Character Animation and Multimodal Behavior Realization System
In this paper we present RealActor, a character behavior realization system for embodied conversational agents based on the Behavior Markup Language (BML). Developed several years ago as part of the SAIBA framework, BML is an XML dialect for describing physical realizations of multimodal human behaviors. It allows modeling of complex communicative utterances which include both verbal and non-ve...
متن کاملTowards a Common Framework for Multimodal Generation: The Behavior Markup Language
This paper describes an international effort to unify a multimodal behavior generation framework for Embodied Conversational Agents (ECAs). We propose a three stage model we call SAIBA where the stages represent intent planning, behavior planning and behavior realization. A Function Markup Language (FML), describing intent without referring to physical behavior, mediates between the first two s...
متن کاملLangage de conversation multimodal pour agent conversationnel animé
This article falls within the realm of dialogue between a human and an Embodied Conversational Agent (ECA). We claim that a specific agent conversational language is needed for such interactions, based on the essential role of emotion in human communication. In order to define this language, we propose a library of Multimodal Conversation Acts is proposed, based in particular on speech acts and...
متن کامل